Papers with query translator
End-to-End Optimization for Multimodal Retrieval-Augmented Generation via Reward Backpropagation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MM-RAG is a promising approach for enhancing the reliability and factuality of large vision-language models . current methods focus on component-level optimizations and necessitate extensive component-specific training datasets . |
| Approach: | They propose a new paradigm that backpropagates global rewards to each component . this backpropage transforms local losses into specific local losses . |
| Outcome: | The proposed paradigm achieves high training efficiency on knowledge-intensive multimodal benchmarks. |